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This  is  a  working  paper,  It  may  be  exponded,  modified,  cr  with¬ 
drawn  at  any  time.  The  views,  conclusions,  and  r»eommenda*ionc 
expressed  herein  do  not  necessarily  reflect  the  official  views  or 
policies  of  the  United  States  Air  Force. 
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This  aaUrial  vug  gtrrr.  it  in  oriwvUtian  talk  to  an  Air  For?*  gro’ap 
Visiting  RAND.  ■  It*  liaitsd  parpen*  la  an  alimentary  »apo»ition  of  so** 
aonceptual  i**u*«  that  ars  relaxant  for  a  critical  urui#rsianding  of 
Sjttiw  Analysis.  Xanj  conceptual  aubtlstiss  and  all  issuai  of  analytic 
tachniqu*  m  avoided. 

Talks  on  this  subject  by  srrsrai  SAND  oollsaguas  'ist*  boon  drann  on 


fr«*ly  without  specific  citation#  aspociall/  thoea  of  C.  J.  Hitch  (An 


Tho  HAND  Corporation#  P-499 )# 


B«  N.  Me!C*an#  8«  D*  3p*obt#  and  A.  J.  Wehlststter#  and  Z  ax  indebted 


«ps«lall7  to  V*  H.  Kaplan  for  belpfal  criticisms. 
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•-•r*.  Cafarturatwl/  ry»  pr^cli-J,  :  lineal/  -..;:*pt*«l  definition  *xliti.  For 
ine  icnwnt  lat  m«  m;  aar*!/  that  by  3j%t<aa  Analysis  w  naan  a  systswatio 
caadLsatlon  of  a  probI«  of  e holes  in  which  sach  step  of  the  analysis  ia 
made  •xpllcit  vharrrtr  possible.  Consequently  v*  contrast  3y»t«ns  Analysis 
with  a  manner  of  reaching  daoiaiont  that  ia  largely  intuitive,  perhaps 
unayst anatlo,  tod  ia  which  xuoh  of  tha  implicit  argument  rcnalne  hidden  ia 
the  xlad  of  tha  decision-maker  or  hia  advisor. 

Sy.tcns  Analysis  ia  an  outgrowth  of  World  War  n  Operations  Rtsearoh, 
although  it  typically  daala  with  oholoea  that  oonoern  operations  farther 
ahead  In  tine,  and  take#  a  somewhat  broader  look  at  problaae  of  Military 
c holas.  Analyses  at  RAID,  for  example,  typionlly  eonaidar  what  equipment 
to  proear*  and  develop  for  tha  Air  Force  of  the  future.  Consequently  the 

i 

analyses  that  are  relevant  differ  a  food  deal  Aran  tha  Operations  Research 
of  Wbrld  War  n.  Pooling  with  the  fatoro,  wo  or*  less  oonstnlnsd  by  the 
•peeiflo  sqaipaMats  and  nodee  of  operation*  that  wn  happen  to  have  at  tha 
Meant.  Vs  have  greater  flexibility  and  range  of  ohoioe. 

Ms  Hffsnnos  between  a  Vbrid  War  ZZ  kind  of  Operations  Sasoaroh 
and  Systems  Analysis  is  lass  a  natter  of  sob  stance  than  of  dogroo. 

Consider,  far  ample,  the  purchase  of  a  house.  If  we  are  Interested  in 
y^y<fig  so  old  boose,  an  associated  decision  about  furniture  will  bo 
involved.  On#  aspect  of  that  decision  nay  bo  th*  a  hole#  of  •  refrigerator, 
and  we  any  find  that  a  space  only  JO  Lubes  side  exists  in  the  kitchen  for 
•  refrigerator,  that  the  hens#  is  sired  only  for  U5  mlt  current,  and 
that  ao  gas  lines  are  available.  Consequently  our  shale*  of  refrigerators 


*  *  ‘ i  %  *"  *  j.  i  i,*  ij  ,  lit*  a  iif f  ir^nt  pro 

If  v»  ii*.  »•-  irsvi.*.*  bc«.~l  rith  m  i-A^ira  vi/s  tho  'rL-.d  of 


>»««•  w  ««n  bars,  including  a  rsfrigsntor*  i*  viiA-opsn.  Yo  l-i  r.o 
l«a{«r  eonatrilr.sd  to  think  ths  rrfrigsratcr  oust  bo  no  woro  than  30 
iaobct  *14o*  and  w  can  conaidsr  tho  altamatiro  of  a  gas  rathar  than  an 
olsetrio  rffrigsrator,  or  rrsn  an  alactric  rffrigsrator  that  aill  otiliaw 
220  volt  ourront  rathar  than  1X5  volt  if  that  altsmaU.ro  la  ralarant. 
QM«r  thaaa  airmxaurtancaa,  our  rang  a  of  eholst  la  far  broad tr  and  tha 
naabar  of  altsrnatlroa  that  aro  ralarant  la  ooaaoqaoatly  far  groatar. 

Vhothar  m  spook  of  obooalng  rofrlgoratoro  or  military  ayatoaa,  acm 
osmoon  oonaoptual  alamanta  ara  lnrolvod.  Yhoooror  wo  ahooao  rationally* 
wo  try  to  balaaoa  tbo  abjaotiraa  no  with  to  attain  against  tha  oosta  of 
tbsir  attainment*  Za  dolaf  ao  errtain  oonaon  questions  aro  always  In- 
roirod.  first,  what  aro  tho'volarsnt  altarca tiros  anyway?  Sooond,  what 
la  prlnolpla  la  tha  toat  of  profarrodnsaa  that  wo  ought  to  apply  la 
•hooting  among  altomatlroo?  Za  othor  words  what  la  our  orltorlon  for 
oholao?  And,  third,  how  do  wo  go  about  tho  aotual  proses*  of  wolghlng 
ohjootlroo  agalaat  ooota  in  tho  ooloatlen  among  altomatlroof  To  woo  a 
word  that  wo  will  dlaouao  a  littla  lator,  what  la  our  "modal"*  of  tho 


oltaatlaa?  Sow  dm  wo  go  about  applying  it,  and  how  dm  wo  intorprot  tho 
romwlto? 


Lot  wa  tarn  flrot  to  tho  quortlon  of  thm  altomatlroo  that  aro 
rtflorant*  Tboro  aro  two  olaaolo  orroro  that  saa  bo  mad#  horo.  Kaoh 
omnalata  of  going  to  ta  ontonabls  soctroao  position*  Conoldtr  flrot  tho 
•ao  trror,  wbiah  It  to  look  at  an  unduly  rootrlatod  rings  of  altamatlraa. 
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s t rxLa  sd  >,7  all  tin#  rn^nl.*!:  lijtivnlsn*  of  .in  t"  *7  •xii'.ir.g  ->li~ 
fxjhiar.'W  atrastv-ro.  Of  uour-j*,  thar*  ar*  e»rtai.-i  al-nint^s  in  r^rr-awtr-g 
****  rargs  0/  shots*  arbitrarily  in  this  **7.  It  probably  atka#  th* 
analysis  far  sera  ecsrsnisat.  Th*r*  ar*  fir  f#w*r  iltaraitiTj*  to  soa- 
aidar,  tad  w*  ar*  1***  bod*Yil#d  by  th*  profelm  of  choosing.  But  ww  any 
P*T  *  high  prla*  for  such  1  sonranisne*.  Vh*n  v*  iapo#*  our  con¬ 
straints  arbitrarily,  Kmc  of  th*  *xfllad*d  alternatim*  my  bo  fir  b*tt*r 
thin  th*  on**  lift  tc  cbeos*  fro*.  7M.1  is  t  good  07  to  g*t  1  bid 
r*frlg*rstor. 

It  1*  sb  equally  good  way  to  g*t  1  b«d  nilifcary  r/xtm,  Consider 
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this  possibility  a*  in  illustration.  It  is  Tory  oonTscnioat  for  th* 
aircraft  doosgcor,  tom  by  doubt  about  th*  sis*  tad  othsr  raiarant 
•hartctoriaiias  cf  th*  payload  that  his  atrplai#  will  carry  aany  ywar* 
h*n<s*,  Sicily  to  issvaa*  that  th*  physioal  oonfiguration  of  1  boob  viji, 
thon  b#  jarotty  auoh  what  it  is  today.  Similarly  it  may  bo  T*ry  se^rmlont 
for  th*  d**ign«r  of  boob*  to  asauao  that  tho  boob  b *r  s  if  th*  future  wf 
b*  of  th*  saa*  sap* ait  j  a*  thaso  of  currant  aodola.  But  look  what  can 
rooolt  frso  such  sharod  oonrosisnc*.  Th*  airplan*  daoignar  say  bolior* 
that  hi*  airy  Ians  asst  bo  big  in  ordar  to  b*  abls  to  carry  a  a 3  big 

a*  th*  sawut  9M«.  la  turn  th*  landing  space,  *fc«th«r  It  b*  fixed  or 
floating,  m y  haw*  to  bo  big.  W*  snd  op  nth  a  ooabinatioa  of  big  boob, 
big  airplane,  and  big  landing  spaoo.  Tit  it  is  quit*  posaibl*  that  a  mar* 
offiniwrt  ay*t«a  on  tho  wivol*  sould  b*  dowisod  by  soobinlag  a  bggb 
in  sis*  if  not  in  bang  with  a  mall  airplan*  operating  from  editing  assail 
airfislda  or  o*rrl*r*.  Xayb#  sc  eh  a  latter  systm  would  not  t#  possible. 


alternative  syatma  that  nxployvj  teats  ~.u-:v;  la  sis*  V-*a  ;  *r 

aodaJL*.  If  v*  look  an  ‘.oduly  "»rr«»  rarge  of  to 

with,  v*  aay  n* v»r  at  an  pos*  ita  qusriion  in  th*  right  ’**7.  And  gsttirg 
*  n**t  answer  to  th#  wrong  question  ray  b*  wers*  than  an  lnesaplat* 
answer  to  th«  right  <$ue*tien. 

W#  can  avoid  th*  error  of  looking  at  an  unduly  narrow  rang*  of  alter¬ 
native*  by  spaolfying  that  we  shall  look  only  at  broad  ayateaa  for  a 
aaapirison,  and  that  all  of  tba  altarnativss  that  in  relevant  In  a  broad 
*7? tew  Kt.il  b*  oonsliortd.  Xa  Um  of  th*  above  illustration,  vs  can 
try  to  look  at  all  possible  ooabinationa  of  tomba  of  th«  future  >dth 
airplane*  and  baa**  of  the  fsrurs.  Tha  groat  ddfSicuit/  which  thia  pro  se¬ 
der*  raises,  of  cours#,  1*  that  of  wartability.  Th*  wore  inclusive  th* 
eyetew,  th*  wor*  alternative*  that  art  relevant,  and  th*  jrntir  th# 
dlfflcnltloa  of  coaparlaon. 

Too  fa*  p*op 1#  appreciate  th*  *anlfold  alt*ra*tiree  that  ar*  avail- 
afel*  whan  on*  look*  at  a  relatively  uroonetrsinad  situation*  Consider  tha 
daple*t  *»rt  of  arithmetic  ill aat ration.  In  taking  what  tombing  airplane 
we  ought  to  design  for  tha  future,  lat  us  concentrate  arbitrarily  for  tha 
Meant  an  Joat  throa  obviously  pertirwmt  characteristics  —  rings,  speed 
and  payload*  Nor*  of  any  oaa  of  tha  as  la  obviously  a  good  thing  in 
itaolf.  We  should  likt  to  fly  farthar,  faster,  and  with  a  biggsr  payload. 
Bite  of  coure*,  wo  achieve  none  0/  th*»«  without  coat.  Ind*«d,  la 
relevant  eases  wa  probably  sw*  aohiava  mere  of  any  ana  of  these  eharactar- 
ietids  of  perforaaiice  only  at  the  cost  of  tha  ether  two,  1st  alone  at  th* 
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t>re*  '  '.art-1  »rl  t  -.i :  s  t  i  : Jii  »r,  -.'i  ivppos*,  *  'Aia  ?xL-i  \ri*.*.r  i.-tl/j 
that  ho  *ouh  }f  *,h«*s  v*  tA«i  53  2i\i/  4  ’"hi  jh1*  ar  >  "’lav*  y%1u*.  W*  Jia 
bar*  4  f»*t  alrplun*  si*  on«  net  w  f  \»t,  and  »o  5n.  ?*ov  hex  *mn7  Alt ■ir- 
aatir*  coabin*  t  i  a  ns  ef  thos*  thr**  3h*r»ct*riJtla#  -la  xx  har*f  W*  can 
tn*v»p  thi*  qu**tion  ^7  uslrc*  th*  ilajpr?a  £Lr»n  hxlow  la  Chart  I.  If  x* 
tak*  any  on*  0 f  th*s#  ch*r*at*rl*tic*  at  a  b+giaitlag  point,  it  can  uxos« 
*Ath*r  of  it*  t m  ralu«*  —  hl$h  or  low.  Bush  of  th***  vtlmt  In  turn 
•an  t«  afttshad  «p  with  *ith*r  th*  hi^h  or  th*  low  ralu*  of  th*  axcond 
*h*rv.ot*ristlo,  *0  that  vx  harx  four  distinct  combination*.  Sach  of 
th***  ooMhinotlon*  la  turn  can  than  b*  aatcfaxd  with  *ith*r  th*  hi&h  or 
th*  1 tv  rain*  of  th*  thirl  ah*r*ot«ri*tie.  What  v*  *od  up  with  or*  (2) 
(2) (2)  or  9  o«Mhlaatiena* 
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Stes  saafe-sr  of  ooablrsation*  of  Irrtsrxxt  is  not  two  *»ltipU*d  bf 
thro*,  !*«.,  rlr,  bwt  rat h*r  two  to  th*  third  pov*r,  which  *qoala  elfiri, 
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sharastariatica  of  interest,  and  *tiil  r**trict  our**l r^n  to  but  i*o 
rain**  if  each,  th*  ruastbar  9!  relaront  combination*  li  (2)^  or  about 
1,000*  Th*  difftrmsc*  b*tv**a  6  and  9  cosbiraiioa*  ia  small,  but  th* 
4iff*r*ae*  b*tw«n  20  (2  tias**  10)  and  1,000  ia  larj*.  Typically  *h*n  ** 
atari  *dth  slaan  drawing  beard*  and  ar*  fr**  to  ooo*id#r  all  altsmatir** 
if  int*r**t  ia  a  prrhlaa  of  th*  future,  there  ar*  rnsj  aiilioa*  of  pcaalbl* 
alt«rnaitr»a.  Th*  problma  i*  on*  of  shooain*  **n*dbly  frat  among  that 
larga  ip*b*r«  films  that  kind  of  a  situation,  it  is  aanifaatly  absurd 
for  anyou*  to  say  that  v*  should  daralap  all  altsmatir#*  ia  a  bardusr* 
fora,  3**  how  th*y  p*rfor*#  and  th*a  shoos*  among  th*«.  It  i*  iaporatlr* 
to  find  a  sh#*p*r  wgr  to  coapar*  th«m.  Th*  bulk  of  th*  altensatir**  asot 
b*  «talad*d  by  a  comparison  that  stills**  f*v,  if  any,  tool*  b*yond 
pencil*,  p*p*p,  and  diacidadnaiing  thought*  Gir«e  that  this  is  th* 
situation,  thor*  i*  **r*ly  a  ea»*  for  making  th*  ebolc*  on  pap*r  as  ear*- 
fully  and  a*  ably  as  wa  can.  H«ac*  th*  d**lr*bility  of  Syst«aa  Analysis. 

Too  notic*  that  all  I  bar*  don*  in  ctUcuaaiag  th*  rang*  of  altars*- 
tivw  1*  to  point  up  th*  orrer  of  going  t®  *ith*r  utrnw.  Th*  unduly 
narrow  analysis  nay  exclude  th*  r* ally  tnt*?*rfciag  alt*matir*s.  Th* 
i*po**ibly  brood  comparison  1*  simply  out  of  th*  question.  lobOdy  but  a 
fool  or  a  charlatan  «r*r  prated*  to  look  at  all  th*  undr«rs*  and  to 
r*oelr*  all  problaas  at  th*  aa»*  tin*,  arms  though  in  principl*  the** 
problaa*  ar*  int*rd*p«esd*nt .  In  a  discussion  th*r*  ic  r*r7  littl* 
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tnat  «an  c«  raid  'rJtitL v*_y  scout  r-cv  tl^;  v.»  cons  «£t  >f  i  zr>ol*a  right 


iap-snd*  in  the  cart l-.;';l.u*  w«?Jl-.ca  it 


i.vi  c.tr. 


is  that  the  rtalyeh  -asst  b-»  7  Try  cmM  v>  tmx:*  hij  suit.-:  *r  t.x> 

wall  nor  too  lir-j?,  -riiich  is  only  to  ssy  that  jui^awr.t  is  essential  »i 

this  very  *arly  stag*. 

7b*  problem  of  the  arlisrioa,  or  tast  0/  prefarredneae,  that  ought 
to  to  used  in  a  particular  problem  is  *l<a/s  with  us.  Ta  iaks  on*  aspect 
of  our  military  problem  as  an  ezsaqple,  lot  us  consider  th#  question  of 
the  preferred  engine  for  tho  beater  of  the  future.  Suppose,  again  arbi¬ 
trarily*  that  only  turbo-jet  engines  are  at  Israe.  One  possible  criterion 
for  eboeainf  among  alternative  engine*  le  that  cf  pounds  of  thrust  per 
pound  of  engine  wr’ght.  dearly  greater  thrust  is  desirable j  equally 
clearly,  light  engine*  are  desire  bis.  tfo  <?na  balance  the  one  character¬ 
istic  against  the  other  for  the  alternative  engine,  that  *e  think  vs 
eoald  have*  The  result  of  a  oocpariaoa  might  appear  as  in  Chart  XI  bole v. 


Ok  the  basis  of  this  comparison  alone  ve  should  prefer  ingin*  A  ta 
login*  B.  But  any  eeoeible  engineer  mill  Immediately  object  that  thi*  is 
to*  simple  a  criterion  for  eagia*  choice*  It  leave*  out  of  account  many 
important  cbanoterietlda,  and  there  is  no  aasurano*  that  thee*  other 


viil  LaMdlAtsly  uk,  ‘’Ij  A  aen  h^Vcis  *>.ir.  2?  I.»  itJ 

specific  fusi  consumption  low-?  Ij  it  to  produce?"  Certainly 

these  are  r»l#nr.t  questions,  and  th.57  do  not  answer  theae elves.  It  Is 
poeeibls  that  Engine  3  is  decidedly  superior  to  A  with  reepeet  to  or.e  or 
aore  of  these  additions!  ebarsct eri sties,  end  then*  *x*  uedeubt edly  othsr 


relevant  charMteristie*  as  wall. 


Moreover,  wo  aay  not*  in  passing  that  thapa  is  one  crthar  question 
that  certainly  ought  to  ha  asked.  Vhat  sisa  of  engine  in  absolute  tanas 
ra suits  fro*  following  such  a  criterion  to  tho  hittar  and?  It  is  possible 
that  vt  would  get  a  60,000  pound  throat  angina,  ona  so  big  that  vs  sight 
nut  ha  interested  in  it  at  all.  The  us a  of  s  ratio  as  a  criterion  for 


shat  cm  yields  no  ssaunuvca  that  the  absolute  goal*  of  tho  operation  la 

K*  "• 

question  will  ho  aa  interesting  or  vjsrsnt  ona, 

Given  tho  difficulties  that  wo  can  got  into  with  an  obviously  in  coo- 
plot  o  oritarion,  what  aro  wo  going  to  do  about  it?  Tho  only  way  to  rooolvs 
tho  question  la  to  Ieoh  at  the  sesqparlson  in  tense  of  tho  context  of  a 
broader  eysteai  where  wo  can  bring  a  acre  complete  criterion  to  bear  upon 
tho  pro  bios,  for  axaaplOf  wo  can  consider  the  context  of  a  strategic 
boohing  efotoa  ao  a  whole.  Suppose  wo  take  a  "reaocnahl#*  list  of  Soviet 
targets  for  a  strategic  heading  casqpaiga*  and  «tip*ilate  that  tho  objective 
of  all  of  the  oyetaoo  to  ho  eoopared  la  to  acquire  ao  great  a  capability 
of  destroying  those  targets  aa  possible  for  a  given  total  budget.  (You 
win  notice  that  I  avoid  all  question  of  what  oooatitutee  a  "reesonableP 
target.)  Wat  eyet«*  that  can  bo  devised  will  haw  tho  greatest  capability 
given  tho  budget  constraint? 


•:r  -'.r..*r  ccas-ari  jon  wiv* 


jyv.-raai  ■-!•»  iri  fru  to  j.'vros*  vc^if  ir ».tn»  * *  «»  3 '-..a  11  irjr  \o  lioo*. 

i  'jtt,  rr.ii ir.*  «>.ish>  jfh'in  rarrl  *4  k.o  xli  V.a  oV.?*r  :c»pon-»«t«  if 

th*  boobing  sfstm,  ia  :cnaiat  sy,  with  th*  jr-satant  ceabat  capability. 

Tho  iaaua  b*tv»*a  angina  A  ar.d  srigia*  3  will  now  tur.d  to  be  molrad.  1/ 
wo  only  li«t#d  tho  tawbnleal  char*ct#riatica  of  ungLnaa  A  *r.d  3,  it  ia 
likaly  that  wo  would  haro  t.vo  oolsamai  on*  ooluan  of  oharaetoriatiaa  In 
which  engirt*  A  wa*  th*  cupor ior  of  snglno  3,  and  a  iccond  ooluan  of  diff  Cr¬ 
oat  charmctariati c»  in  which  *ng±n*  3  mi  suporio?  to  onglno  A*  So 
oxprosaod,  thoro  i*  no  coanon  doncadnaior  in  t«na  of  which  of  thoeo 
difforont  cbaractoriotiaa  can  bo  ocnporod.  Such  a  Hating  wold  auffic* 
for  "t  4  cholco  only  if  on*  ongino  uniforaly  dowla*t*d  th#  other, 
that  l«f  waa  bet tar  in  aach  characteristic.  Caw  Just  do*#  not  expect  to 
find  that  eort  of  dcainsno*  la  an  intonating  prahlna.  Interesting 
problwea  art  typiaally  not  that  «a *7.  Therefore,  in  ordor  to  ohooa# 
between  th*  two  enginee  w#  wait  find  a  way  to  reduce  th«ir  direr**  —rite 
tad  d— arit*  to  a  oesaaon  baaia.  Tho  oontext  of  tha  strategic  bouhlng 
syrt—  aa  a  whole  aakaa  it  poaaibla  for  wa  to  find  that  canon  denondLoator. 
lach  aarlt  of  a  particular  • agine  typo  taeda  to  bar*  ita  lxpaot  5#  t*T*e 
of  a  contribution  toward  greater  target  capability.  Cocrerseiy  each 
daaarlt  tanda  to  hare  ita  affaot  in  tana  of  decreased  capability.  Tha 
Mt  effect  of  the  aorlta  and  4— erite  af  aaab  will  rwawlt  in  a  final 
oestrlbuti—  to  telial  ayrtoa  capability.  Their  difference*  can  bo 
eopreeeed  la  tea-*#  of  tho  oca— go  darcednator  of  targets,  and  which  ocfia# 
ia  b«tt«r  can  bo  established  given  a  bedget  constraint. 

Saw  can  wo  deiemin*  tho  appropriate  acal*  of  too  boobing  ucapalgn 


at  laoooT  !fev  big  *  Imdget  should  wo  izpooo  aa  a  constraint?  It  say 
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VTf \  JL  *$  /■%  ;  tr.-'vo*,  i*'  thi.,3  *\. 5 1 *, i ^ * ‘-t  V".*/  pr  sci  ii  -^*  }'«"'*  *.ra* 

um  u_L  '-ba*  *'«  can  lo  U  ta  try  b'jdgjt  l.«v-»ls  *.*.4  •>•»•*  '■hat 

hasp-sna  it  «r*ch  level,  IS  ’*+  «•*  la:ky  •**  /ini  t’.ut  var  prefer*©::*  ftr 


one  angles  type  ov-jr  the  other  iocs  wt  dapw-d  upon  the  budvri  I<r?.»l. 
That  ir,  o.toie*  between  the  two  ia  net  sensitive  to  variation  in  the 

i 

scale  of  th*  caatpaign,  If  to,  we  can  aak*  a  strong  riccasser.dation  far 
that  «r\$in* , 

Th*  criterion  in  our  boobing  ouspei^n  conpariaan  is  expressed;  in 
toms  of  neadnua  target  capability  for  a  jiraa  total  budget*  Th*  3 ri to¬ 
ri  on  eoeld  equally  w*ll  ho  *apre**<ad  th*  other  way  around  in  tins  of 
sdnlsuH  total  budget  for  a  giwa  tarj*%  capability*  At  any  particular 
seal  *  that*  tve  sapr**sIon*  ncraally  a*otust  to  th*  >ut  thing.*  If  m 
«xpmi  th*  criterion  th*  on*  say*  »  gel  a  r**ult  Hit*  that  show  in 


•  Th*  abconml  oa*«  where  th*«*  eoepreseiona  would  not  caount  to  th* 
i* asm  thins  requires  that  on*  alternative  ho  sot*  «q?*n*iv«  than  another 
•t  law  objective  lrrtlj,  leee  expensive  at  high  objective  lavels,  and 
har*  th*  mm  or  lower  total  so  eta  aaaoaiated  with  higher  objective 
lrrals,  not  Just  lower  averts*  eos*s  per  unit  ef  th*  objective.  This 
cas*  is  anlikaly  in  praatis*.  Henwrer,  for  th*  curious* 

SappoM  Alternative  A  can  g*i  5  targets  at  a  nlnlwun  mat  af  $50  a., 
tact  AltarmtiTe  S  saa  got  5  target*  aoly  at  a  ainisua  cost  of  155  a.  If 
v*  ire  only  interest *d  in  5  targets,  A  la  ursdstakeably  our  ehoia*.  Sat 
swppoe*  wn  «r*  interested  in  aore  target*,  and  S  mold  get  •**  20  target* 
at  a  total  mat  of  $50  a*  (a  lower  total  eoat  than  that  associated  with 
5  targets  for  Bf)  while  A  could  set  ua  20  targets  only  at  a  oost  of  |60 
Um  la  thd*  case,  if  a*  express  err  criterion  in  tens  of  wartira  capa¬ 
bility  fear  a  $50  a«  budget,  n  get  an  a newer  of  B  sad  20  target*.  AH  is 
wall.  3BmwJ4  wo  express  mat  aritsrUn  in  terras  of  ttlrriara  east  far  5 
targets,  hewer,  w*  got  an  answer  ef  A  cad  th*  mm  eowt  of  $50  edllian 
hot  a  lower  sapabillty,  el  marly  an  inferior  solution.  Her*  it  sake*  a 
difforeno*  which  way  w*  express  th*  criterion, 

Th*  trouble  aria**  in  this  unusual  ces*  boeans*  th*  antning  of  "at 
any  particular  seals'*  is  eablguous.  B*e«as*  tatal  seats  are  ant  alway# 
rising  wiy»  higher  objective  levels,  were  than  on*  objectiv*  level  is 
a* moisted  with  any  given  cost  level,  Ha  uablguity  aria**  in  th#  usual 
«M  illustrated  in  fart  (2s)  af  Chart  IT,  and  w»  oan  identify  a  particular 
s*al*  by  reference  either  to  a  oost  or  an  objective  level* 
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Chart  CII.  In  ;&uo  ins  iarrin  of  surrsriori  vr  ;f  nr n’-yH  ••■» 

3  av«r  37-it-nx.i  •wsploylrg  A  is  zuan  *.h*  :mc-. » , 


OUJ*  ccaparlaoa  in  the  wmticct  if  a  birraUar  375 tra  is  cnrr-wt  the  :«Ls- 
-ding  iaprwsian  of  a  technical  superiority  of  sajir.a  A  or*?  3  that  vaa 
generated  by  the  orarly  oiapli  orltariaa  of  aaulsus  thrust  par  pound  of 
engine  wight  (Chart  II). 

?h*  ooaparlson  in  Chart  in  is  la  tanas  of  a  scale  of  4  $1  billion 
bwi£*t  (Part  1)  or  ICO  targets  (Part  2).  At  v*  try  different  scale*  of 
•ffart,  notios  what  happens .  At  each  seal*  that  n  try,  say  $1  billion. 
t2  Wllion,  tod  so  on,  w  shall  try  to  sstablish  that  syetee  with  writes 
targst  capability.  Once  that,  systea  has  been  found,  its  cost  can  bo 
transposed  4  different  chart  that  will  graph  tho  relationship  between 
tho  caster  of  targets  that  can  bo  destroyed  and  tho  total  cost  noceasary 
for  thatr  dost  motion.  Ve  and  up  with  the  chart  in  Part  (2)  of  Chart  17. 

Incidentally,  such  a  chart  »erres  to  dsaoaatrate  tho  fallacy  of  one 
ooooonly  sneountsred  criterion.  ¥hat  does  it  Man  if  somebody  says  the 
criterion  for  this  Job  is  to  got  tho  »#t  for  tho  least?  Tho  "least*  in 
this  case  Mace  lover  dollar  cost,  which  sears  we  now  to  the  left  in 
fort  (2)  of  Chart  17.  &*t  getting  tho  **ost"  weens  that  wo  destroy  tho 
noat  targets,  ldtioh  aeons  that  we  go  up.  But  w*  cannot  go  up  and  to  the 
loft  sissilt aneoualy  in  this  chart.  Higher  capability  Mans  higher  coat 
ooee  w»  haw  det trained  the  efficient  sy stems  to  be  Mployed  st  wrloas 
stales  of  effort,  huh  a  criterion  lawless  as  in  a  slaple  eerbal  centra- 
diction.  to  wm«rt  it  into  a  eeartingfui  prep&sitioa,  we  asst  rephrase  it 
fcy  saying,  »3et  tho  aoot  for  a  stipulated  coot  j  *r,  alteraatiwly,  for  a 
stipulated  ebjeeUw  got  tho  levee t  eoet  that  you  eon." 
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;«5  fvr*  „  ^j+yn  *  r-,qTr?<i  % h  s  -id  1 1  ^  ~  s  ^  *  sc'#  7*ju  ^  ib-c'it  V':*3 

.\c-.ua1  prccst*  of  c^sp*ri*5n  in  *  lyai  ms  AuAlysla.  We  -cm  at  olrrvlit ?  a 
ml  lif*  performance  27  ii - «rr..ati7»  aystma,  and  ruvirslly  ve  want  to 
2Ai<*  to*  »:-2*ilatio£i  a*  r^illj'i:  *.a  po-jaibia  for  the  lr.pcr~.xni  factors  at 
issue-  I  slrsst  the  -j-cri  ** .tapcri- tni.**  It  is  vary  cinar  in  any  iixiiyaij 
that  <»  cannot  tiki*  arerything  into  account .  Something  snub  be  left  cut 
in  order  to  Mk«  th*  analysis  .enable.  Oiran  that  we  hat*  to  aliadLnatt 
eosethi ng,  w  shall  try  to  eliaiaet*  th*  less  important. 

Sometime*  th*  problssu  of  our  military  analyst*  ar*  compared  to  th* 
problem  of  th*  owner  of  &  racing  stabls  who  want*  to  win  a  hors*  rao*  to 
b*  run  many  years  hence,  on  a  track  not  yrt  built,  between  horaot  not  yet 
ben.  Everybody  weald  agree  that  a  prediction  of  th*  kind  of  grace  that 
would  grow  is  th*  Irflald  of  th*  rao*  track  i*  quit*  unimportant  in  th* 
analysis,  and  n**d  not  b*  laciudsd.  But  *aa*body  would  certainly  quarrel 
ulth  a  failure  to  consider  th*  ocspoaUioc  of  th*  running  surface  itself . 
Sac*  track  fancier*  tall  a*  that  sea*  raee  track*  ar*  faster  than  oth«rs, 
and  that  «on*  bars**  perform  r*latiT*ly  much  b*tt*r  on  alow  tracks  than 
they  do  a.  fast  tracks*  Again  wo  only  point  to  scaething  at  one*  impor¬ 
tant  and  difficult j  v«  do  not  tell  you  bow  to  do  it.  How  do  you  decide 
which  factors  to  suppress  and  which  ones  to  include?  And  yet  an  analysis 
not  only  of  necessity  suppresses  some  things}  it  aggregate*  many  ef  th* 


obrleualy  important  things  that 


•  A  multiplicity  of  small  things 


it  bo  aggregated  into  a  nail  number  of 


1*  big  thing*.  Only 


when  we  here  don*  this  will  »h*  problem  of  ceaqparison  be  reduced  to 
manageable  dimensions*  Consequently  we  shell  simulate  real  life  issee- 
pletely  by  xacmatratlng  only  os  tbs  things  that  w*  think  are  important 
mod  abstracting  firm  the  unimportant.  2a  other  words,  w#  shall  create  e 
•model." 


.'.sfcgfo-f*  •'  •’ 


t!,j  ;i  -T  .’i-,  sn  i"»>  x-i  ii  *r.-i  -jv-vst.*  »vtv* 

V 3 ‘L.ui .  Tri  s  >.\i  l,;ror* i  if  careful,  -i  dll  s  i  jstisjthisi  Is 


If  a*  v^nt  to  build  tb?  b-ntv  *<:■*  »*k  hew  alt  irr.,4tiri 


builiir.^  r.a‘.*tiaie  co*par-s  ir.  strength,  weight,  aesthetic  appeal,  u:d 

cost,  If  -**  ’sint  to  build  th*  bast  bemoar,  v«  is'x  vlut  performance 

chariot criati 3 s  sr*  atUinabi*  within  th*  ajqpactrS  stats  of  th*  art  in 

.  *1 reraft  eenstruaticn,  wtsat  relrsrwt  tr*d*-off j  cats  b«  rad#  aaong  thoa* 

characteristics,  and  what  <i#f*n*«s  future  boabers  >*}  ha**  to  fac*.  Thar* 

ar*  mnf  acre  rtlarant  qawtions  that  could  b*  listed  la  *iifc*r  case*  All 

aaiat  b*  answered  a*  boat  th*y  can  ha  in  order  to  aak*  a  ooaparlson  possible, 

and  th*  bettsr  th*  answer*,  th*  b*tt»r  th*  analyst*  a*  *  whal*.  Th*r*  is 

llttl*  aor*  to  say  at  a  larsl  of  gsosral  principle  sxewpt  that  it  la 

0  laport-iiit  that  th*  rarlous  degree*  of  confidence  with  which  particular _ 

factor*  ar*  Mtl>at*d  should  b*  txprmtd,  and  tha  variance  attached  to 

particular  eotlaat#*  la  important  as  wall  a a  th*  best  {ottiu  about  th* 

•  - 

*atp*ct*d  magnitude*. 

<Ht«c  a  co— ion  d*n— dnator  with  which  to  coapar*  physically  divers* 
things,  all  or  a  good  part  af  th*  aod*X  will  typically  ba  quantitative  is 
character*  H«no«  th*  talas t*  of  th*  aathoaatician,  af  valu#  *l**wh*r*  is 
tha  analysis*  ar*  indlapentahl*  at  this  stage*  W*  turn  to  a  aathasatician 
sat  •»  anoh  far  his  skill  la  p*rfor*dng  saas  aoapaAatiooa  aa  for  hia 
ingenuity  in  escaping  th«a.  With  Jud^—nt,  aa*  mj  b*  abl*  to  boil  dawn 
aa  wmerkably  large  m— bar  af  altarnatires  to  a  ambor  *odoh,  whilo 
farad  da bly  largo,  la  aanag*abl*«  With  ingenuity,  on*  way  b*  abl*  to 
•usatlWto  siapllfled  fa?  intricate  satins— tioal  manipulation*  Whan  all 

0 

of  th*  hornet  tricks  af  th*  tndo  that  permit  such  reduction  bar*  boon 


utiliiad,  vs  '’A '3  the  U*  "ill  Lack  upon  tu  rand is 

naos-»a  2*  c sspurations ,  I^prs-raaenti  la  the  «rt  of  .uath-wtttlc.vl  adnipu- 
laii:<n  and  the  ievAiopsorst  of  the  tUetroriij  3*'.o*ilatc.*  hara  oontrilut  <*i 


grs-atly  to  ids  potential  x‘or  useful  syart-ss*  mal/sss* 

So  fir  v»»  hair*  tAlkini  about  i<rr*r*l  csssaon  conceptual  alaaenta  that 
enter  any  prablwa  of  choice.  3ut  behind  *11  of  then  i*  on*  trotablescae 
el  want  of  which  you  are  *11  aware.  When  w*  talk  of  the  future  w*  are 
speaking  of  *  futur*  largely  unknown*  Any  analyst*  of  current  4*ci*ion* 
that  will  tl ad  u*  in  th«  futur*  ia  plagued  by  the  diffiruiti*#  raised  by 
uncertainty.  For  Military  studies,  what  will  tha  tntm/  be  Ilka  in  tha 
future?  How  good  ara  our  forecast*  of  tha  fceehnologiaal  iwproT«**ota 
that  will  ba  possible  if  ww  will  only  give  tha  go-ahead  signal  now  to 
certain  development  aad  production  programs?  And  in  the  arant  our  Mili¬ 
tary  devises  are  actually  employed  in  the  future,  what  chance  element* 
will  help  to  determine  their  sueease?  Haw  lucky  or  unlucky  will  we  be  in 
the  particular  situation*? 

a 

We  are  uncertain  about  all  of  that#  thing*,  and  our  uncertainty  giro* 
us  a  twa-fold  pro  hi**.  Because  we  are  so  uncertain  about  the  magnitudes 
of  nany  of  the  important  factors,  we  don’t  knew  how  to  push  a  comparison 
between  alternative#  to  a  definitive  conclusion  wren  when  we  hare  a 
definite  criterion  for  obeice  between  them*  Aa  if  that  were  not  bad 
aeough,  the  formulation  of  a  criterion  for  choice  in  uncertain  situations 
aa ir  ttWf  bo  elusive.  To  take  the  duple  at  sort  of  example,  different 
people  nay  give  different  answer*  to  the  question  of  whether  they  would 
prefer  a  certainty  of  $5  to  one  chare*  in  twenty  of  getting  JlCO.  let 
the  aatheaatlcal  aor.oetatlon  of  gain  iu  the  ease  in  bath  oases.  We  cannot 
fix  on*  definite  criterion  for  chelae  between  thee#  two  that  will  apply  to 
all  individuals. 


it  ir.  ij'r.rx*  i  -iln'.  •' 


-  >  -  - .  - 


cu  „ 


*.‘.J  5434 


-sS* 


■;ia  ?xz  *1  .-'i  ■  '^n;#r*4ir. 

Cnee  we  have  i  psr-tiriLir  r^r 
result  can  b«  tested  f:r  it 5 
that  enter  into  the  w-tl/sis. 


7  ibcut  ths  zKi^rt  lav.!  L~  cur  ) . 

It  t43-id  upon  >na  53t  of  israspcions,  that 
enaitivity  to  -3  hang  *3  in  aary  of  the  factors 
We  can  try  an  altar*!  seal*  of  effort  by 


aaouadng  a  different  budget,  we  can  double  the  strength  of  the  estimated 
•n*ry  defenses,  an d  10  on,  ssd  see  what  such  tests  do  to  our  choices* 

On*  essential  of  scat  syste&s  <uialyse«  is  *  battery  of  sensitivity  tests 
that  show  hew  the  results  depend  upon  different  factors*  If  we  are  lucky, 
1 m  aaerge  with  ?.  result  that  is  cooperatively  insensitive  to  a  wide  range 
of  change  in  sany  critical  elswents  of  the  analysis.  If  we  are  unlucky^ 
we  emerge  with  at  best  wjuirecal  reecHMseed^tions,  although  the  factors 
upon  which  choice  critically  deponds,  and  the  particular  uncertainties 
that  it  is  important  to  try  to  resolve,  will  have  been  clarified. 

Per  dealing  with  uncertainty,  same  kinds  of  statistical  uncertainty 
oan  be  treated  explicitly  in  the  nod  el.  This  possibility  raises  technical 
■attars  that  I  do  net  propose  to  go  into  here  beyond  noting  that  the 
criterion  can  be  expressed  in  a  somewhat  different  fora*  Instead  of 
seeking  the  sdnlaaa  cost  system  sawog  system*  all  of  which  have  an  eajpee- 
tatiec  of  attaining  a  certain  capability,  the  criterion  can  be  rephrased, 
for  example,  in  tame  of  a  oenfidenoe  level:  "Choose  the  least  ooetly  ef 
the  syiteaa  that  here  a  90  per  cent  aetaranse  ef  being  able  to  do  a  stipu¬ 
lated  job.*  Uven  this  different  sort  ef  criterion,  different  aodel 
Manipulations  way  be  called  for,  and  one  aay  get  a  aomswhat  different 
eolation* 
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*.«i  ;ca4  'Jf  h i  :*rt 3  v*  -vlo  p-rr.  a,*.  ani ->r* vin  future  V7  r.A.w^  eihsrs 
in  -;ppo*ed  -ILnetlcra .  In  Vu*.  '■'sy  •<*  .1*7  rot  be  cvjuh*  out  -no  badly  by 
part shifts  of  fsrt'ir.a,  ?>?  axiipl*,  if  v<*  are  nalirnj  reccasaanda- 


ti  ons  far  novel  types  of  squicxcr.t  at  in  isjrly  sta^s  of  dsvclapaiant, 

v»  my  vwt  to  receassrsd  sample  progress:  not  *A  is  prefarred  to  3," 
but  “ieveiap  at  least  both  A  snd  3  from  among  a  ncoah  larger  nuabar  of 
passible  sltamatiTa*.,»  If  both  are  developed,  wo  ire  such  less  exposed 
te  catastrophe  than  if  va  had  pl^aped  all  out  for  only  A  or  B.  Tbs  a  hone* 
that  loth  will  ha  failures  i*  perhaps  such  lewer  than  that  sithsr  will  be 
a  failure  If  w*  concept rats  exclusively  upon  it.  To  revert  to  oar  future 
boree-rec#  analogy,  on*  nay  wot  to  analyst  carefully  In  ohsooing  preferred 
braadiag  stock,  hat  prsf'ir  to  sock  ooro  than  one  oolt  froa  mors  than  on# 

•at  of  parents.  Bat  not,  of  course,  without  licit.  Stud  fooa  and  tha 
prices  of  brood  wares  are  high  for  blood  line*  of  proved  merit.  And 
asdern  hardware  development  for  ailitary  application  is  not  cheap  either. 

Tha  principle  of  hedging  can  be  extended  all  tha  way  through  to  fore# 
composition  and  asploywent  decisions.  One  my  argue  cogently  for  system 
of  mixed  weapon  types  on  tha  basis  that  we  are  lass  uncertain  about  getting 
tolerable  results  than  in  tha  case  of  a  pure  system  of  one  type,  even  In 
oases  where  our  best  gusas  of  probable  result*  tends  to  push  us  toward  a 
pure  systma.  Bat  the  seat  of  this  type  ef  bodging  rises  as  wo  novo  from 
the  early  stages  of  research  and  development  toward  procurement  and  use, 
and  m  can  afford  loss  of  it.  Moreover,  as  we  move  from  early  to  lata 
stages  of  development  tha  burden  of  uncertainty  lessens,  and  hedging  loses 
team  of  Its  great  value.  Incidentally,  this  consideration  suggests  that 
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projrta  it  isrja  ;oi.-.d  tc  ;«  '•■*•’.  i  P  fur  4  lorg  p-»ri>i  of  tic*  .cyn/ 
by  th*  need  to  d*y*iop  t  juliana*  iyi‘,?»,  It  nay  ba  wry  dieirabl*  to 
<*•*«•  ^ur  *niin*  «hoi«*  to  &  tLu*  when  aur  decision  con  b«  t  better  on*. 
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Tou  antic*  that  non#  of  th*a*  ccuceisSe  telle  you  precisely  what  to 
do  in  particular  situations.  It  is  y*rj  clear  that  Systea*  Aralysis  u 
currently  practiced,  and  probably  as  practiced  in  th*  future,  is  mich  aor* 
an  art  than  a  acience.  To  b#  *ur*  th#  analyst  ou|ht  to  npLey  whatever 
available  scientific  tool#  ar*  appropriate  at  parti  aular  place*  In  th* 
analytl*,  but  hi*  operation*  a*  a  whole  ar*  not  characteristic  of  "3cliee*» 
with  a  capital  *3.*  Wh  have  stressed  th*  part  that  Judffwnt  plays  at  each 
*t#«*  *f  a  Systea*  Analysie.  What  scop*  should  th*  analy*i«  talc*  anyway; 
what  la  th*  appropriate  balance  that  escapes  being  owraabltioucly  big  or 
unduly  ooostriat«d?  What  arlterion  ought  to  b*  applied?  What  factor*  can 
b*  *^ppr*a**d  ia  the  analysis?  Of  Urn*  that  r— in,  what  decree  of 
aggregation  of  particular  factor*  is  pendscibla?  Sow  nr*  they  to  be 
Manipulated?  Sow  la  th*  result  to  be  interpret**!? 

normrwr,  our  T*ry  division  of  3yst«ae  Analytic  into  *#tagss»  has  tap 
auoh  *f  a  out-and-drled  flavor*  although  that  division  1*  useful  in  order 
to  talk  about  sea#  conceptual  issue*  on*  at  a  tin*.  In  practise  nobody  la 
likely  to  ftr*  you  a  prsbleai  neatly  and  correctly  f orcalated,  with  th* 
identification  of  relevant  alternatives  a  Batter  for  staple  emasaration 
and  th*  other  stay**  to  follow.  On*  of  our  senior  practitioner*  *f  th* 
art  of  ayutsaa  Analysis  insists  that  th*  ter*  itself  is  unfortunate  and 
should  be  replaced  by  Systems  Design.  In  hi*  view  th#  perception  of  th# 
problsa  end  the  finding  of  relevant  alternative#  ar*  th*  k*y  creative  parts 
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alt smatiroe  -'or  its  solution,  are  per'-Ac*  th*  aojt  iap»r*-*«t  tualiiia* 
th#  syst®#  analyst  s«fi3»  .Usd,  lik*  th*  .sound  jud^sunt  aljo  required, 
tksa#  qualiti™  cannot  bs  taught  ia  t ara*  of  g«n*ral  prlncipia*  or  sot 
rules.  Orss  can  only  repeat  adseniiiansr  n3y»*j«tj  ajuLiysia  1*  sx>  *ub*ti- 
tuts  for  sans#,"  acd  "There  are  aalther  preseriptiarji  ner  subatituto*  for 
ingenuity  in  analy*!#.* 

ScMtlsu*  whsn  » trass  in  properly  put  upon  all  th*  difficulties  that 
prscludo  a  definitive  analysis  of  decision  problem  in  tars#  of  a  full- 
fledged  eolsntlfio  discipline,  on*  encounters  th*  fallowing  sort  «f 
reaction  to  a  study:  *fh«r*  are  so  «an?  iaponleribls*  ia  th»  situation, 

*»  ««ny  ttwerUiatiss,  that  J  Just  J»ve  nu  faith  ia  th#  results  that 
•KfP  frwa  all  this  msa  of  data  saddiscussion.  I  pr*f*r  to  avoid  It, 
and  therefor#  1  s**id  Systaa  Analysis."  Thsrs  ia  a  direct  answer  to  this 
typo  of  understandable  objection,  Tbe  difficulties  are  Intrinsic  in  the 
naturo  of  th*  problem  that  aro  studied,  Th*y  are  not  difficult!  ss  that 
ar*  grafted  onto  the  problem  Just  because  particular  techniques  aro 
brought  to  boar  on  tbm.  Tho  mm  harden  of  uncertainty  mat  ba  born*  by 
anyone  oho  trio*  rationally  to  arrive  at  doolaiona.  Tbo  aaa  who  aolvoo 
oeagaltx  prohlm*  in  tho  span  of  five  dsutaa  on  th*  intuitive  baals  of 
»  sooner  Military  or  business  Jnrrgmni  and  sxperlsnse,  and  that  ia  certainly 
possible,  my  than  forgot  about  it  and  slsop  easily  at  nignt.  In  oontrsat, 
tbs  amt  who  has  owrtcsd  too  years  oc  >a  imrslrad  Systm*  analysis  of  th* 
saw*  problm  oay  slaws  badly,  but  only  because  ho  has  bseas*  aoutsly  aver* 
of  all  ths  pitfalls  in  tho  problm. 
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I*  yt>*4  tAk*  bright  people  uhe  %r*  vci  tr.iif  i sally  tr\in-<4,  -,r.*  ir »  -.i-stAj/e-i 
fra**  ih*  particular  probl**  iid  consequently  have  no  blc.3,  .mi  *i>-*  thssa 
asple  time  jujd  opportunity  to  bring  their  coabined  iivvrce  csporisr.o*  to 
boar  upon  the  problsna,  they  certainly  ought  to  b«  able  to  do  considerably 
batter  then  one  harassed  Indian  who  is  given,  say,  three  aocths  to  solve 
an  iaqpoesibly  big  problem  with  little  assistance.  And  they  ought  to  do 
better  even  when  the  comparison  is  a  fairer  one. 

One  should  not  ovsretres*  the  difficulties  of  finding  the  best  solu¬ 
tion  to  eoaplttx  problems  by  analysis,  even  though  the  difficulties  are 
great.  To  be  sure,  asny  problems  by  their  eery  nature  are  so  smag>l«x  that 
one  would  acrer  be  confident  that  the  best  result  had  been  found.  At  the 
•erne  tire  eery  useful  results  aay  be  achieved.  In  particular*  one  may 
tackle  a  preblsa  La  order  to  find  a  better  rather  than  the  best  solution. 
Instead  ef  starting  with  a  clean  drawing  board,  looking  at  all  the  rele¬ 
vant  alternatives  that  can  be  discovered,  and  endeavoring  to  find  the 
beat,  one  say  taka  as  a  starting  point  the  existing  program  or  pattern  of 
4eoisiens  that,  unless  shortly  altered,  will  bind  the  future*  Tasking  that 
aa  a  starting  pelct.  la  what  respects  does  the  program  seem  to  be  deeeon- 
strebly  badt  If  sueh  respects  can  be  found,  one  oan  proceed  to  the 
demonstration  that  they  sru  bed.  fcae  seeks  as  alternative  program  that 
east  be  expected  to  do  batter  in  the  likely  contingency,  and  yet  be  better 
adapted  te  meet  unlikely  but  peseible  eoatirgenolea.  Probably  *e  weuld 
be  better  advised  Is  many  prebisms  te  tackle  the  design  of  better  syutsme 
rather  than  the  abstract  analysis  of  the  best.  If  we  did.  we  might  be 
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It  t*  anljr  fair  to  Add  that  vtvlls  Oystema  Analyst  •  can  And  ovujht  to 
bo  such  bottop  than  conventional  staff  vork,  it  eon  b*  *»r*«.  Kany  syrlsns 
analyses  share  an  iaproseive  The  technical  die  auction  is  lone  and 

oorrlicatsd#  tho  ohart*  in  slsjant,  the  aatheoatloal  »*ppondi»eo  in 
formidable,  and  thoro  it  jreat  display  of  taohnieal  Jw’fon  and  virtuosity. 
Such  a  faoad*  can  reveal  very  good  analyse*  or  it  oan  conoeal  to ry  bad 
one*.  Tf  it  conceals  bad  -v-.**,  it  nay  bo  wore#  than  no  analysis  at  all. 

Tho  difficult!  so  of  understanding  tho  toehnical  diepl.gr  m y  lapodo  ratbo r 
than  facilitate  relevant  criticise.  Tho  whole  elaborate  structure  oaa 


tonooal  a  big  butch  or  a  big  bias  in  toms  of  arbitrsrily  oxoludad  alter- 

* 

natives,  an  Improper  criterion,  bad  execution  of  tho  analysis,  or  poor 
lntorprotatlon  of  tho  results.  But  JL1  tools  oan  bo  usod  or  abusod.  Tho 
possibility  of  ulsuse  nood  not  and  should  not  dstgr  us  tho  opportunity  to 
•ako  food  uso  of  th#  aval Uhl a  tools.  1ft or  all,  "Tho  substituto  for  bod 
OMdjuio  la  food  analysis."  Bov  also  do  you  know  it  it  bad? 
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